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ABSTRACT 


This  ...w  .'c  -aph  presents  an  exposition  of  the  subject  of 
truncated  sequential  tests.  Although  the  main  intent  of  this 
roport  is  tutorial  in  nature,  some  previously  unpublished 
results  have  be©.,  included. 

Special  emphasis  has  been  given  to  the  following  topics: 
a)  the  practical  necessity  fpr  truncation,  b)  the  effects  of 
truncation  on  the  performance  of  the  test,  c;  the  results  of 
computer  simulation,  and  d)  rules  of  truncation  and  application 
to  principles  of  design. 
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EVALUATION 


This  report  is  part  of  a  series  of  tutorial  monographs  on  various 
topics  on  system  theory  and  information  processing.  The  purpose  of  tin 
series  is  to  bring  to  the  attention  of  electronic  equipment  designers , 
inform»t<or  resulting  from  recent  research  studies ,  i:.  c.  tutorial  far;.: 
suitable  for  applications.  The  work  was  sponsored  by  the  Laboratory 
Directors  Discreet ion ary  fund,  under  Task  DI  6U-2. 

Sequential  tests  in  electronic  detection,  hare  been  considered  for 
application  to  optimal  detection  problems  (See  for  example  RADC  TDR  60-70A 
Applications  of  Decision  Theory  to  Electronic  Equipment.’’  Today,  come  of 
those  ideas  have  been  applied  to  the  design  of  practical,  though  sophis¬ 
ticated,  radar  “quipments .  Though  a  sequential  detector  is  superior  in 
performance  than  it 1 r  n on-sequential  counterpart,  it  is  more  complicated 
to  impliment.  It  is  only  through  understanding  of  principles,  and  the 
availability  of  performance  calculations  that  one  can  determine  if  the 
fxtra  sophistication  justifies  it.  in  any  particular  application. 

Though  this  report  is  primarily  tutorial  in  nature,  it  does  contain 
some  previously  unpublished  results.  The  preparation  of  tuis  report  was 
motivated  by  the  following  conditions: 

a)  Expository  material  on  the  subject  from  an  engineering  point  of 
view  is  sparse,  thougn  a  chapter  is  included  in  the  books,  "Detection 
Theory"  by  Ivan  Selin,  and  more  recently""Signal  Detection  Theory"  by 
Hancock  and  Wintz. 

b)  There  are  contributions  from  the  engineering  detection  problem 
that  are  of  use  to  statisticians. 

It  is  hoped  that  the  future  will  soon  bring  forth  a  rather  full 
treatise  in  book  form  on  this  fascinating  subject  from  an  engineering 


point  of  view./ 

H/uWOQp  WEBB  r 

ProjeM:  Engineer 
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INTRODUCTION 


The  applicat^ct.  of  sequential  t^ets  to  radar  problems 
originated  some  ten  years  ago  At  SIGNATRQN  ve  have  studied 
extensively  various  truncated  sequential  teste.  The  current 
monograph  is  based  on  the  results  of  a  number  of  these  studies, 

Although  the  present  monograph  is  intended  to  be  tutorial 
i.»  nature,  it  a'a~  contains  some  new  previously  unpublished 
material. 

The  authors  are  particularly  grateful  to  their  Air  Force 
monitor,  Mr.  Haywood  Webb  of  RADC  for  recognising  the  need  for 
the  collection  and  formal  presentation  of  this  material.  The 
authors  also  wish  to  acknowledge  that  the  material  presented 
in  Section  b  of  This  monograph' is  based  on  the  joint  work  of 
Julian  J.  Bussgang  and  Dr.  Michael  B.  Marcus  of  the  RAND 
Corporation  which  was  published  by  the  RAND  Corpor^lon.,* 


1. 


RADAR  DETECTION 


The  application  of  statistical  teats  of  hypotheses  to  the 
radar  detection  problem  is  by  now  a  well-known  approach.  As  a 
result  the  practitioners  cf  this  field  have  developed  a  habit 
of  .intermingling  the  statistical  language  with  the  engineering 
one.  The  statistician,  examining  those  of  our  writings  on  the 
subject  that  are  concerned  with  engineering  applications,  fre¬ 
quently  will  fail  to  perceive  the  significant  statistical  con¬ 
tribution  which  may  be  contained  in  them.  On  the  other  ha 
the  design  engineer  who  wishes  to  extract  significant  infor¬ 
mation  for  his  system  will  tend  to  be  equally  puzzled  by  the 
statistical  terms  and  may  fail  to  recognize  the  practical  sig¬ 
nificance  of  the  analytical  results. 


In  order  to  overcome  these  difficulties  this  section  of 
the  monograph  discusses  the  semantic  equivalences  of  the  engi¬ 
neering  and  statistical  nomenclature  used  in  what  follows.  This 
effort  at  translation,  as  if  it  were,  should  help  to  make  the 
material  of  this  monograph  more  accessible  to  workers  ir.  both 
fields.  Moreover,  it  may  also  help  to  encourage  the  engineers 
to  avail  themselves  of  other  material  on  sequential  topics  and 
vice  versa . 


The  problem  of  deciding  whether  a  target  is  present  or 
absent  can  be  regarded  as  a  statistical  test  of  two  alternate 
hypotheses.  Thus  the  design  of  the  target  detection  system  is 
the  design  of  a  statistical  test.  The  observed  variables  are 
the  received  pulses.  The  detector  is  the  device  Which  con¬ 
structs  the  test  eta  tie-tic.  The  test  statistic  is  the  function 
of  observed  variables,  Which  is  used  to  make  decisions  and  is 
represented  by  the  voltage  at  the  output  of  the  detector.  The 
test  procedure  is  the  logic  of  operations  on  the  received  signal 
Which  hive  to  performed.  The  inequalities  which  have  to  be 
e famine d  to  reach  a  decision  are  tested  by  comparing  the  voltages 
at  the  output  of  the  detector  to  suitable  threshold  voltages. 

The  action  following  the  decision  that  the  target  is  present  is 


an  “alarm".  Tho  action  foliating  the  dacisioo  thot  the  target 

is  absent  is  a  "dismissal".  The  probability  a  of  accepting  the 

altarnata  hypothesis,  ("target  present") ,  When  the  null 

hypothesis.  Hq  ("target  absent"),  is  true  is  the  probability  of 

error  of  the  first  kind.  This  probability  in  the  radar  context 

is  the  probability  of  false  alarm.  Similarly,  the  probability 

p  of  accepting  the  null  hypothesis  HQ  ("target  absent")  when 

iche  alternate  hypothesis  H.  ("target  present")  is  true  is  the 

* 

probability  of  arror  of  the  second  kind.  In  the  radar  context 
this  probability  is  the  probability  of  false  dismissal.  If  p 
is  the  probability  of  false  dismissal  then  1  —  ft  is  the  prob¬ 
ability  of  detection,  i.e.,  the  probability  of  declaring  target 
present  When  it  indeed  is  present.  The  number  of  observations 
required  to  complete  the  test  is  known  as  the  sample  number  and 
is,  in  effect,  the  number  of  radar  pulses  Which  must  be  re¬ 
ceived  from  the  target  to  complete  the  detection  process. 

Since  radar  pulses  are  usually  emitted  at  a  uniform  rats, 
the  number  of  pulses  to  complete  the  detect ion  process  is 
di.se  tly  proportional  to  tha  time  required  to  complete  the  teet 
and  the  not lots  of  time  and  number  of  observations  to  complete 
the  teat  are  interchangeable.  Since  a  likelihood  ratio  test 
on  independent  samples  involves  a  sum  of  logarithms  of  likeli¬ 
hoods  of  individual  observations  the  physical  realization  of  a 
likelihood  ratio  detector  involves  an  integrator.  For  a  fixed 
sample  size  test,  ±.ike  a  Neyman-Pearson  teat,  this  integrator 
a  fixed  time  constant.  For  sequential  tests  the  time  con- 


HT^nr  m  uxrianiA 


A  sequential  test  is  a  statistical  test  of  hypotheses  Where 
the  amount  of  data  which  is  examined  is  not  specified  in  advance; 
the  number  of  observations  Which  are  taken  is  a  random  variable. 
Such  a  procedure  has  the  virtue  that  on  the  average  the  number 
of  observations  required  is  smaller  than  the  fixed  number  of 
observations  required  in  the  fixed-sample  procedure  yielding 
the  same  probabilities  of  error.  That  is,  with  fixed-sample 
size  hypothesis  testing  procedures,  the  number  of  observations 
to  be  taken  is  determined  in  advance  and  is  a  function  of  the 
probability  of  errors  wmch  will  be  tolerated.  This  fixed 
number  of  observations  is  then  taken  after  Which  the  value  of 
the  test  statistic  is  computed  and  compared  against  a  single 
threshold.  One  of  the  two  hypotheses  is  accepted  depending 
Whether  the  test  statistic  does  or  does  not  exceed  the  threshold. 


A  sequential  test,  on  the  other  hand,  is  performed  by 
j  establishing  two  thresholds  and  successively  taking  observations 

until  the  test  statistic  which  is  recomputed  with  each  new 
observation,  exceeds  the  upper  threshold  or  falls  below  the 
lower  threshold.  On  the  average,  a  sequential  test  which  yields 
the  same  error  probabilities  will  require  fewer  observations 
than  the  fixed  sample  procedure.  Conversely,  if  the  number  of 
observations  of  the  fixed  sample  procedure  were  chosen  equal 
to  the  average  number  of  observation*  of  the  sequential  pro¬ 
cedure,  either  one  or  both  of  the  error  probabilities  of  the 
|  sequential  test  would  be  smaller  than  the  corresponding  errors 

I  in  the  fixed  sample  test.  Thus,  either  from  the  point  of  view 

j  of  the  number  of  observations,  or  from  that  of  the  error  prob- 

»!  abilities,  the  performance  of  the  sequential  procedure  is 

H  superior  to  that  of  the  conventional  fixed  sample  size  test. 

m  . 

i ' 

4  The  sacrifice  Which  is  made  in  exchange  for  this  improved 

performance  is  the  unpredictable  number  of  observations  re¬ 
quired  in  the  sequential  procedure?  i.e.,  although  the  average 


number  of  obcsr vat ions  can  ba  expected  to  b«  smaller  than  the 
number  of  obaarvatlona  required  in  the  fixed  sample  procedure, 
individual  tests  may  require  an  extremely  larqe  number  of 
observations  relative  to  the  average.  In  fact,  some  test  may 
continue  unresolved  for  such  an  extended  period  of  time  that 
the  demand  may  ariae  that  tha  tasting  procedura  terminate  and  a 
decision  be  made  aa  to  tha  hypothesis  Which  should  be  accepted. 
It  is  a  recognition  of  thi«  fact  that  laada  ua  to  a  study  of 
truncated  sequential  taste. 


3.  REVIEW  OF  RESULTS  FOSi  UNTRUN^ATED  TESTS 


The  theory  of  sequential  probability  ratio  teste  (SPRT)  as 
developed  by  Wald  is  presented  in  Ref.  2.  In  this  section  we 
do  not  develop  the  theory  but  present  those  general  aspects  of 
sequential  analysis  which  will  be  necessary  for  a  consideration 
of  truncated  sequential  tests  (TST). 

Let  u«  assume  that  we  are  interested  in  testing  the  null 
hypothesis  Hq  that  the  value  of  the  parameter  a  In  the  prob¬ 
ability  density  function  of  a  random  variable  x,  p(x;a) ,  is 
zero  against  the  alternative  hypothesis  that  the  value  of 
the  parameter  is  a^.  According  to  the  SPRT  procedure,  suc¬ 
cessive  observations  on  the  random  variable  x  ar«  made  ^nd  aftor 
m  observations  (m=l,2,...)  the  logarithm  of  the  likelihood  ra^io 


m 


In 


p(Xj ,x2. . .xm 

P*'xl**2 


ja. ) 


.  • .x_;0  ) 
m 


(3.1) 


is  computed  and  compared  against  two  parallel  thresholds  (or 

boundaries)  InA  and  lnB.  In  statistical  terminology  is  the 

m 

relevant  test  statistic.  If  Zm  >  InA,  the  procedure  is  termi¬ 
nated  by  making  decision  d^  to  accept  hypothesis  ;  if  Z^  < 
lnB,  the  procedure  is  terminated  by  making  decision  dQ  to  accept 
hypothesis  Hq;  otherwise  (when  lnB<Zm<lnA)  another  observation 
x  M  is  taken  and  the  testing  procedure  continues. 

It  can  be  shown  that,  neglecting  excess  over  the  boundaries,* 
the  probability  a  of  Type  I  error,  i.e.,  rejecting  Hq  when 
a  =  0,  and  the  probability  ?  of  Type  II  error,  i.e.,  accepting 
Hc  WJnn  a=o^  are  given  respectively  by 

a  *  *nd  P  =  (3-2) 

♦"excess  over  the  boundaries"  is  the  amount  by  which  the  value  of 
Z^  at  termination  stage  n  exceeds  the  boundary,  i.e.,  zn~-nA 
or  lnB-Zn. 


Thus  in  order  to  construct  a  test  with  performance  (a, 0)  we 
choose  the  thresholds  InA  tnd  InB,  where 


A  •  (l-$)/a  end  B  *  e/(l~a) 


(3.3) 


A  pictorial  representation  of  the  testing  procedure  is 
given  in  Fig.  3-1.  It  will  be  noticed  that  the  region  of  Z^, 
m>0,  is  separated  into  three  parts*  accept  Hq,  accept  and 
continue  testing. 

In  Whet  follows,  we  assume  that  all  observations  are  in¬ 
dependent  so  that 


m 

p(x.  ,x„  ...  ,x _ja)  =  IJp(x>;a) 
1  1  m  i*l  1 


(3.4) 


and  hence 


Where 


pCx.ja.) 

■i  =  in 


(3.5) 


(3.6) 


We  adopt  the  notation  that  n  is  a  terminal  etage  of  the  standard 
8PRT  and  thus,  neglecting  the  excess  over  the  boundaries, 
is  the  test  statistic  for  s  completed  sample. 

Since  in  radar  problems  §  is,  in  general,  •«*rr?i;*ed  with 
the  elgnal-to-noise  ratio,  for  the  sake  of  simplicity  and 
clarity  in  reference  to  errors  of  Type  I  end  II  we  will  use 
here  t"e  radar  engineer inc  terms*  "false  alarm"  probability 
for  the  probability  of  Type  I  error  end  "false  dismissal* 


probability  for  the  probability  of  Type  it  error. 

An  important  quantity  in  a  sequent ial  test  is  the  aver age 
sample  number  (ASK),  Which  1»  the  nurnbe*.  activations  needed 
on  the  average  to  arrive  at  a  decision.  The  ASM  is  a  function 
of  the  true  value  of  the  parameter  &,  and  for  independent  samples 
is  given  by 

ASX  =  MDiM-kfffiW.lW  (3.7) 

Where  L(a)  is  called  the  operating  char*icterlatic  function  (OCF) 
and  ia  the  probability  of  accepting  hypothesis  Hq  given  that  * 
is  the  true  value  of  the  parameter  under  test  and  Where  Ejc(a) 
is  the  expected  value  of  z  given 

p(x;a, ) 

Ez(a)  »  Etln  p(^To|  1*1 

From  the  definition  of  a  and  8,  it  is  evident  that  L(0)  *  1-a 
and  LCa^)  =  8.  Therefore,  a  feeling  for  the  overall  performance 
of  a  sequential  test  can  be  obtained  simply  by  examining  the 
OCF  and  ASN  of  the  test. 

It  ia  a  property  of  sequential  teste  that  no  other  statis¬ 
tical  tast  of  hypothesis  HQ  against  can  be  constructed  with 
a  smaller  average  sample  number,  and  yield  aa  small  an  a  and  8 
a*  a  sequential  teat.  Conversely  no  othev  teat  can  achieve  a 
smaller  a  and  8  and  also  require  on  the  average  less  observa¬ 
tions  than  the  sequential  test.6,8 » 10 
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Although  a  prool  by  Stain9  provides  asaurar.ce  that  the 
sequential  tests  will  terminate  with  probability  1 ,  it  ia  clear 
that  sane  tests  may  last  longer  than  can  be  tolerated*  The 
teat  length  is  a  random  variable  and  long  tests  will  occasionally 
occur  even  when  the  parameter  a  which  ie  under  test  equals  zero 
or  exceeds  the  nominal  value  a<  due  to  the  non-sero  variance 
of  the  test  length,  furthermore,  when  the  SNR  which  actually 
occurs  has  an  intermediate  value  0  ■-  a  <  a^,  the  resulting  ASK 
becomes  itself  very  large  thereby  indicating  that  even,  cm  the 
average,  the  test  may  take  much  longer  than  if  a  ia  exactly  0 
or  a^.  This  last  point  can  be  understood  by  referring  to 
Tig.  4-1  Which  illustrates  typical  ASN's.  It  follows  that 
there  will  be  occasions  when  the  testing  must  be  prematurely 
terminated  and  a  decision  reached  on  the  basis  of  the  already 
available  data. 

When  situations  arise  whan  these  very  long  tests  can  not 
la*  tolerated,  it  becomes  necessary  to  modify  the  test  procedure 
in  ordwx  to  accelerate  the  termination  of  the  tecc.  Sonet ines 
it  ia  even  necessary  to  modify  the  test  sc  that  one  can 
guarantee  that  the  teat  will  terminate  prior  to  some  specified 
stage  n  *  N. 

The  necessity  of  truncation  *.•  especially  evident  in 
practical  engineering  problems  where  thw  urgency  to  terminate 
the  testing  procedure  may  increase  with  every  succeeding  sample. 
An  example  cf  such  a  situation  ia  given  by  radar  detaction 
Where  a  "hangup"  on  one  particular  target  may  allow  other  tar¬ 
gets  to  pass  by  undetected  or  may  eauso  a  decrease  of  available 
radar  response  time. 

This  urgency  can  be  stated  in  terms  o*  a  nonlinear  in¬ 
creasing  cost  associated  with  successive  samples.  According 
to  such  a  cost  function  succeeding  samples  become  so  costly 
that  their  relative  value  decreases  rapidly  thareby  placing  a 
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demand  on  the  experimenter  to  end  the  testing.  Several  methods 
of  accelerating  or  terminating  the  testing  are  presented  in  the 
next  recti on. 


5.  RULES  FOR  -.TRUNCATION 


There  are  several  ways  in  which  an  accelerated  or  truncated 
sequential  test  can  be  constructed. 

One  way  to  achieve  the  desired  change,  in  the  test  procedure 
is  to  modify  the  parallel  test  boundaries  shown  in  Fig.  3-1  to 
curve  and  meet  at  stage  N.  The  stage  N  is  called  the  truncation 
stage  and  the  modified  test  a  truncated  test.  Two  manners  of 
modifying  the  boundary  deserve  special  attention.  In  the  first 
case,  no  change  in  the  test  procedure  is  introduced  until  the 
truncation  stage  itself.  In  the  other  case  the  boundaries  can  be 
brought  closer  together  with  every  stage  to  monotonically  converge. 
In  the  former  case,  the  truncation  may  be  said  to  be  abrupt  and  in 
the  latter  case  gradual.  It  is,  of  course,  also  possible  to  let 
t.he  boundaries  asymptotically  converge  at  infinity,  guaranteeing 
that  the  test  will  accelerate  but  not  necessarily  terminate  by  a 
particular  stage.  Figure  5-1  illustrates  some  of  the  different 
ways  of  modifying  the  boundaries.  When  the  boundaries  do  in  fact 
meet  at  the  truncation  stage  N,  we  specify  at  that  stage  only  one 
rather  than  two  thresholds  so  that  there  is  no  "defer-decision" 
region  at  that  stage  and  the  test  must  terminate. 

It  can  be  observed  that  from  this  point  of  view  the  parallel 
boundaries  ~>f  the  Wald  test  are  a  consequence  of  the  uniform 
cost  of  additional  observations  independent  of  the  stage  number. 

On  the  other  hand,  the  converging  boundaries  can  be  interpreted 
as  a  consequence  of  an  ever  increasing  cost  of  additional  obser¬ 
vations  so  that  the  cost  per  observation  is  a  non-linear  monctoni- 
cally  increasing  function  of  the  stage  number.  The  abrupt 
truncation  becomes  required  when  the  cost  of  an  additional  obser¬ 
vation  becomes  infinite. 

When  sequential  tests  are  used  in  the  context  of  a  3ignal 
detection  problem,  it  is  sometimes  possible  that  the  circumstances 
of  the  problem  permit  the  observer  to  control  the  energy  of 
successive  pulses.  Suppose  that  the  energy  of  successive  pulses 
is  gradually  increased.  Since  the  energy  of  successive  pulses 
can  be  thought  of  as  the  cost  of  taking  observations,  the  situation 
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in  which  t he  boundsriew  remain  parallel  but  the  energy  increases 
isr  eouivalent  to  the  situation  in  Which  the  energy  of  successive 
pulse  remains  the  same  but  the  boundaries  convarge.  The  proce¬ 
dure  >  based  on  gradually  increasing  the  energy  of  successive 
pulses,  implies  feedback  from  the  receiver  to  the  transmitter 
carrying  information  whether  or  not  the  test  has  or  has  not  yet 
terminated. 

Modifications  of  tie  test  procedure  need  not .  of  course,  be 
restricted  to  tbs  gradually  converging  boundaries,  (or  gradually 
increasing  energy).  It  is  possible,  depending  on  the  particular 
situation  that  the  formulation  of  the  problem  leads  to  a  multi¬ 
stage  test  cf  statistical  hypotheses  Which  does  not  entail 
monoton ically  converging  boundaries  (or  increasing  energy)  but 
introduces  more  complicated  boundary  shapes.  Some  examples  lead¬ 
ing  to  such  boundary  shapes  are  discussed  later  in  this  section. 
Other  topics  relating  to  the  modified  sequential  testa  which  are 
discussed  include  the  analysis  of  performance  of  the  modified 
tests  and  tests  with  variable  energy. 
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A  sequential  test  with  trapezoidal,  sloping  boundaries  has 
been  analyzed  by  Anderson^  in  tbe  case  of  a  random  variable  which 
la  a  Wiener  process.  Mora  generally,  we  can  consider  a  class  of 
sequential  test  procedures  that  entail  monotonically  converging 
boundaries.  A  test  procedure  of  this  type  can  be  called  gradually 
truncated.  A  difficulty  arises  in  the  treatment  of  gradually 
truncated  sequential  tests  in  that  the  boundaries  are  themselves 
a  function  of  the  sample  size,  Which  is  a  random  variable.  In 
this  section,  we  outline  a  method  for  obtaining  approximately  tbe 
Average  Sample  Jshanber  and  the  probability  of  accepting  an  alter¬ 
nate  hypothesis.  Our  presentation  is  based  on  Bussgang  and 
Marcus.* 

Following  Wald2  consider  the  sequential  test  cc  a  sequence 

X  =(x.  ,x^, . . . ,x  )  of  discrete  random  variables.  We  assume  that 
m  l  ’  2  m 

associated  with  the  hypotheses  Hq  and  are  the  two  alternate 
probability  density  functions  po(Xm)  and  P1(\)  which  govern  the 
observations  in  the  sample.  The  modified  sequential  test  is  per¬ 
formed  as  follows:  with  each  new  observation  added  to  the  sample s 
the  likelihood  ratio  p1(Xfal)/p0(Xm)  is  formed.  The  process  is 
continued  as  long  as 


f  (m)  p,(X )  f>(m) 

o  -  i  m  ,  _  A 

e  '  i-isp  <e 


m~i,  2 , * . . , n—  > 


and  ceases  at  some  stage  n  as  soon  as  one  side  of  the  inequaiies 
(6.1)  is  violated.  The  modification  of  the  test  consists  of  the 
fact  that  the  boundaries  are  not  constants  but  a  function  or  m. 

For  the  sake  of  clarity,  the  terminal  stage  is  denoted  by  r»  as 
distinguished  from  an  arbitrary  stago  m;  si  .ue  the  termination 
stage  depends  on  the  run  of  the  s&mplo,  n  is  a  random  variable. 

Let  the  violation  of  the  lower  inequality  be  associated  with  tbe 
acceptance  of  Hq  and  the  violation  of  ft*  upo**-  inequality  with 
the  acceptance  of  H. .  Suppose  the  function  i  (©)  Is  mor-oton ica  1  ly 


non -decreasing  and  the  function  f^(m)  is  monotonically  non- 
increasing.,  Truncation  occurs  for  the  smallest  value  of  m,  N, 
at  which  f0(M)*f^(ll)  since  at  that  stage  the  inequality  (6.1) 
must  he  violated.  Notice  that  if  the  two  hypotheses  were  equally 
likely  and  the  costs  of  accepting  incorrect  decisions  were  equal, 
then  it  would  be  reasonable  to  require  that  at  truncation 

f0(N)«fi(N)*°. 

Lat  E[f (n)  Id^H^]  be  the  expectation  of  the  function  f  of 
the  terminal  stage  n  given  that  the  test  terminates  in  the  deci¬ 
sion  dt  to  accept  the  hypothesis  and  that  the  hypothesis  Hj  is 
true;  1*0,1;  J*0,1.  Bussgang  and  Marcus1  (p.7)  have  shown  that, 
neglecting  the  excess  over  the  boundaries,  the  following  two 
equalities  hold  for  i-0,1  and  J=1,Q  respectively: 

B[exp  fi(n)fd1,Hj]  =  ?(dilHi)/P(dilHj)  (6.2) 

E[exp-fi(n) =  P(dilHJ)/P(d. |Ht)  (6.3) 


and  hence 

6 [exp  fi(n)|di,H^]  E(exp  -fi(n) |di,Hi]  =  1  for  i/j 

(6.4) 

Por  the  case  of  coni. “ant  boundaries  f  (  i)=constant ,  i.e., 

f^(n)  *  in  A 
f0(n)  -  In  B, 

the  result  (6.4)  became*  evident.  Specifically,  for  i=i  *nd  j»0, 
(6.2)  and  (6.3)  imply 


E[©xp  fL(n)  !<5lfHQ]  =  (l~PVa 


(6.5) 


E[«xp  -fx(n) jd1,H1]  =  a/(l-6) 


(6.6) 


To  illustrate  how  these  equalities  can  be  used  to  evaluate 
approximately  the  performance  of  a  sequential  test  consider  the 
exponents  specifying  the  boundaries  that  are  of  the  form 


f0(r»  = 


r*  /  *  n _ %  o 

-  °  c  -  sr> 


(6.7) 


;i<n:  =  s  11  -  TP 


n  ri 


(6.8) 


where  0<rQlr1^l  and  a  and  £  are  positive.  The  graph  of  f^(n) 
is  shown  in  Fig.  6-1.  The  graph  of  fQ(n)  is  similar.  In  What 
follows  assume  independent  observations  and  let  the  tiida  sign 
(-)  distinguish  the  quantities  characterizing  the  modified  test 
from  the  corresponding  quantities  in  the  Wald  teat.  For  the 
specified  eet  of  exponential  boundaries  the  Inequality  (6*1)  ther 
becomes 


P,(x,) 


-  3>  °  <  E  l»  S&r  ‘  1  «•»> 


0'~j 


m=l ,2 , . . . ,n-l  <  N 


If  a/N  and  E/N  are  small  (i.e.,  N  is  large)  the  class  .of  tests 
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specified  by  (6.9)  tends  to  the  standard  Wald  tests  with  a*s*ln  A 
and  6  »  b  «  -In  B.  We  consider  the  problem  of  finding  the  approx¬ 
imate  ASM  and  the  probabilities  of  error  of  tbe  modified  test 
a  and  B. 

In  order  to  simplify  tbe  resulting  expressions  assume  that 
a  and  6  are  sufficiently  small  so  that  given  H  the  decision  is 
d^  most  of  the  time;  then 


E(n|H^ )  m  E(n|d1 ,H^) 


(6.10) 


The  following  approximate  expressions  are  obtained. 


E(nlH. ) 


1  EUlHj)  +  r^a/M 


(6.11) 


and 


a  «  s“a  (1  + 


~2 

V 


MBtslHj)  +  rta 


I  ) 


(6.12) 


Similar  expressions  apply  when  the  null  hypothesis  is  true  where 
r0,  b,  p  replaces  r.,  a,  a  and  £(nld0)  replaces  E(nldj). 

By  keeping  only  the  first  moments  of  n,  the  boundaries  are 
approximated  by  straight  lines.  We  note  that,  in  general,  as 
the  boundaries  converge,  excess  over  the  boundaries  will  take 
place.  The  approximations  in  (6.11)  and  (6.12)  ignore  teste 
which  terminate  at  the  truncation  stage  N  and  are  therefore 
meaningful  only  if  c locusts tancsa  of  the  problem  are  such  that 
most  teats  terminate  prior  to  the  truncation  stage. 


7 .  ABRUPT  TRUNCATION 


In  this  section,  we  discuss  an  abruptly  truncated  sequen¬ 
tial  probability  ratio  test*  The  boundaries  of  the  test  remain 
parallel  until  the  truncation  stage  N.  At  the  truncation  stage 
only  one  terminal  threshold  is  used  and  the  terminal  decision 
must  be  made.  In  the  interest  of  providing  explicit  results, 
the  discussion  in  this  Section  will  be  specialized  to  apply  to 
the  test  for  the  mean  of  a  normal  process.  This  corresponds  to 
coherent  detection  of  a  known  signal  in  white  noise. 

A  truncated  sequential  procedure  is  illustrated  in  Figure 
7-1.  On  the  vertical  axis  is  plotted  the  value  of  the  test  sta¬ 
tistic  Z  for  (continuous)  values  of  n  on  the  horizontal  axis, 
n 

For  each  value  of  n  the  value  of  ZR  is  compared  against  the  two 

thresholds  InA  and  InB.  If  exceeds  the  threshold  InA  before 

n-N,  the  decision  is  made  to  accept  the  hypothesis  H^.  If 

the  value  of  Z  falls  below  the  threshold  InB  before  n=w,  the 
n 

decision  d  is  made  to  accept  the  hypothesis  H  .  If  remains 
o  on 

between  the  two  thresholds  up  to  n-N,  then  at  this  stage  no 
further  samples  are  taken  and  th«  value  of  Z^  is  compared  with 
the  terminal  threshold  x.  Hypothesis  is  accepted  if  Zn>x, 
otherwise  hypothesis  is  accepted. 

The  four  labeled  paths  in  Figure  7-1  show  the  four  possible 

ways  in  which  a  detection  procedure  can  terminate  in  a  truncated 

test.  Decision  d,  is  made  when  either  the  test  statistic  Zn 

1  n 

exceeds  InA  or  remains  within  the  two  parallel  boundaries  and  is 

greater  than  the  terminax  threshold  x  at  the  truncation  point  jj. 

These  two  possibilities  are  shown  toy  path  (1)  and  (2).  Decision 

d  is  made  whenever  Z  crosses  the  lower  boundary  InB,  or  remains 
o  n 

in  tr*  deferred  decision  region  until  the  test  is  truncated  and 
the  test  statistic  is  then  below  x.  These  two  possibilities  are 
shown  by  paths  (3)  and  (4). 

The  mathematical  simplicity  of  the  expressions  (3.2)  and  (3.7) 
Which  specify  the  performance  of  a  sequential  test  is  lost  to  a 
large'  extent  when  truncated  sequential  tests  (TS?)  are  consi¬ 
dered.  The  difficulties  center  about  the  fact  that  now  we  must 


consider  separately  the  outcome  of  teste  Which  terminate  before 
truncation  and  those  that  terminate  at  truncation.  There  is  no 
simple  transition  fnaa  the  analysis  of  the  untruncated  procedure 
to  the  truncated  case.  Let  the  probabilities  of  orror  of  n  TST 
be  (hp  and  i?T . 

A  truncated  ♦‘est  is  a  compromise  between  an  entirely  sequen¬ 
tial  test  an  2  a  fixed  test,  It  is  an  attempt  to  reconcile  the 
good  features  of  both  of  them?  the  sequential  feature  of  examin¬ 
ing  observations  as  they  accumulate  and  the  fixed  test  feature  of 
guaranteeing  completion  within  a  specified  sample  sis.  It  is 
cleti  that  modification  of  the  test  boundaries  changes  bu-h  the 
probabilities  of  error  and  the  distribution  of  the  sample  size. 
For  example,  if  in  Fig.  7-1  the  threshold  InA  and  lnF  are  set  to 
yield  errors  (a,0)  in  the  untruncated  procedure,  the  intioouct ion 
of  a  truncation  point  at  n=N  will  decrease  the  ASK  but  increase 
the  values  of  a  and/or  8.  The  net  effect  is  a  loss  of  performanc 
That  is  if  we  could  adjust  the  thresholds  of  the  truncated  test 
so  that  aT=a  and  BT=6  then  the  truncated  procedure  would  have  a 
larger  ASM  than  the  untruncated  test.  Conversely  if  we  could 
adjust  the  thresholds  of  the  truncated  test  so  that  the  ASN  of 
the  truncated  test  were  equal  to  the  ASN  of  the  untruncated  teat 
for  OSafa^,  then  wither  or  both  cl.  and  would  be  greater  than 
the  corresponding  values  of  the  untruncated  test  with  the  un¬ 
adjusted  boundaries.  It  should  be  recognized  that  in  the  trun¬ 
cated  procedure  the  choice  of  the  location  of  the  terminal 
threshold  x  influences  the  values  of  a,.,  and  This  influence 

decreases  as  the  truncation  stage  increases,  *or  v  ,y 

large  values  of  N  (large  in  comparison  to  the  ASN),  the  values  of 
and  9^  are  not  sensitive  to  the  value  of  y;  for  small  values 
of  N  the  values  of  aT  ^nd  Br  are  very  sensitive  to  the  position 
g*  the  terminal  threshold  x„ 

In  a  STRT  the  probabilities  of  errors  a  and  ?  are  not  a 
function  of  the  parameter  a^,  but  are  dependent  only  on  the 
setting  of  thw  thresholds  InA  and  InS,  The  ASM,  however,  is  de¬ 
pendent  both  on  the  values  of  a.  and  |.  In  feet,  if  the 

variable  under  test  it  the  mean  of  a  Gauss  distribution,  the 

2 

quantity  of  interest  is  not  ASS  alone  bur  a.ASN,  i.e.T 


the 


"average  energy"  of  the  teat..  Although  the  ASN  varies  not  only  j 

with  a  but  also  with  ’■be  quantity  a^ASN  varies  only  with  a,. 

In  the  fbxad  "ample  teat  fox  the  mean  of  the  Gauss  distribution, 

g  f 

we  recall  the  error  probabilities  sre  a  function  of  the  "total  •  | 

energy"  a*nf  where  nf  is  the  total  {and  fixed';  number  of  samples;  1 

the  larger  a^  the  smaller  the  value  of  the  nf.  Consequently  for  .  ! 

the  case  of  a  TST,  a  fixed  value  of  t*  becomes  relatively  large  in 

c  output iaon  with  the  ASN  as  a .  increases.  The  larger  «  is  in  com" 

x 

parison  with  theASJJ,  the  more  ’-he  TST  resemb  es  a  SPRT  test  and  > 

correrpondingly  aT  ar.d  BT  approach  a  and  B.  Thus  for  a  TST  the 
valu^  cf  a^  influences  the  probabilities  of  error.  Late*,  it  is  I 

shown  that  the  performance  parameters  of  a  TST  are  in  fact  uni-  \ 

versa  1  functions  of  the  truncation  energy  in  the  test  for  the  | 

mean  of  white  noise. 

As  stated  previously  ,.t,  «oy  TST  there  will  be  a  net  lose  in 
the  performance  over  the  untruncated  i'VRT.  in  fact,  if  we  attempt 
■>  maintiin  a^=a  a».d  8^=?  a^N  d^crocses,  the  separation  between 
thresholds  inA  and  lnd  must  be  increased  accordingly,  until  in  the 
limit  lnA=®,  ln3=~<*>,  a^ASN-a^N  and  the  resulting  TST  has  become  a 
fixed  sample  test.,  At  this  point  the  net  savings  in  energy  of  a 
TST  over  a  fixed  sample  tost  is,  of  course,  zero.  j 

t 

7.1  1*SlU elf.  Results  for  the  Test  for  the  Kean  of  White  Noise  i 

In  general,  the  expressions  f_i  cw  and  gT  as  a  function  of 
the  boundaries  are  difficult  to  obtain.  However,  when  tfrs*  loga¬ 
rithm  of  the  likelihood  ratio  can  be  represented  by  a  Wiener  j 

process,  or  th'  sum  of  a  Wiener  proce- -  and  a  deterministic  func-  ! 

tion  „f  time,  explicit  results  are  available  from  the  work  rf 
s 

T.  W.  Anderson.  The  logarithm  of  the  likelihood  ratio,  i.e,,  the 
test  statistic  can  be  approximately  represented  in  this  way  when 
the  sequential  teat  (SPRT)  is  for  the  mean  of  a  normal  variable 
on  successive  independent  samples.  The  derivation  of  these  rv  - 
suits  is  given  in  Appendix  A.  Here  we  give  approximations  which 
are  valid  for  a  variety  of  applications. 

The  samples  unde*  tsst  follow  the  density  function 


f {x, ,a) 


1 


(7.1) 


a 

_ _  exp- ( x  t -a }  /2 


The  null  hypothesis  is  a=0  and  the  alternate  hypothesis  is  a=a^„ 

We  let  t  be  the  time  variable  so  that,  if  AT  is  the  time  between 
observations  and  m  the  number  of  observations,  the  elapsed  time  then 
is  t=ir  AT.  Let  T  be  the  truncation  time  so  that  T=NAT.  For  a 
test  represented  in  Fig.  7~1,  we  then  have  the  following  approxi¬ 
mate  results: 
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These  last  two  equat. ions  dhamon slrate  that  the  probabilities  of 
error  of  this  truncated  test  are  universal  functions  of  the 

3 

"truncation  energy"  a^T„  It  can  be  determined  directly  from 
eqs  (7  2)  and  (7.3)  that  if  we  let  lnA~®  and  inB=-«  the  result¬ 
ing  aquations  for  aT  and  PT  are  exactly  those  that  express  the 
protoabilit iss  of  error  for  a  fixed  sample  test  with  energy 
and  threshold  x,  namely. 


4. 


(7.4) 
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(7.5) 


From  the  expressions  (7.4)  and  (7.5)  it  also  follows  that  in  order 
to  achieve  performance  and  8  ,  the  (terminal)  threshold  x  must  _ 


be  set  at 


x  - 1  (cr1^)]3  -  [#"1<8f>33} 


(7.6) 


and  the  Lest  must  have  enerc/ 


a  1  *  f  ~ 


=  [4* 


a-}  ♦ 


(7.7) 


The  last  two  relations  are  t he  Known  results  for  fixed  sample 
hypothesis  tests. 

7 . 2  A  Truncated  Sequential  Test  with  One  ^reshc-ld  at  Eaet  Stage 

We  see  from  (7.2)  and  (7.3)  that  aT  and  are  a  universal 
function  of  a^T  and  depend  on  the  three  quantities  InA,  InB,  and 


26 


i;.  There  are  therefore  three  quantities  Which  can  be  adjusted 
be  satisfy  the  conditions  that  a,r  and  flT  have  specified  values. 

In  practical  problems  a  third  condition  to  uniquely  specify 

these  three  quantities  for  a  aiven  set  (a-,,  9-,)  must  be  judi- 

3  "  11 

ciously  chosen.  For  example,  in  the  case  of  sequential 

detection  of  a  raaar  return,  the  probability  of  an  echo  from  space 
is  so  small  that  U  is  vary  unlikely  that  the  test  will  terminate 
by  the  teat  statistic  interacting  the  “target  present"  threshold 
lnft.  Therefore,  most  of  the  time  the  test  lengths  will  be  con¬ 
trolled  by  the  location  of  the  lower  threshold  InBj  the  closer 
this  threshold  to  zero,  the  more  likely  is  the  test  statistic  to 
cross  it  early  and  the  shorter  the  test  length.  Thus  for  any 
value  of  a®T  we  can  minimize  the  dismissal  test  length  by  rais¬ 
ing  the  lower  threshold  as  close  to  zero  as  possible  While  simul¬ 
taneously  lowering  the  value  of  x  and  raising  InA  in  order  to 
maintain  the  desired  values  of  and  Under  those  conditions, 

the  value  lnA=®  is  the  value  of  the  uppe-  threshold  which  leads 
to  the  smallest  value  of  -InB.  Since  no  alarm  could  occur  prior 
to  the  terminal  stage,  the  probability  of  false  alarm  would 
then  be  determined  solely  by  the  terminal  threshold  x.  Under 
these  circumstances  only  one  threshold  exists  at  any  stage.  For 
such  a  single  boundary  test  (Fig,  7-2)  the  general  expressions 
(7.2)  and  (7.3)  simplify  considerably  and  for  the  target-absent 
and  target-present  cases,  we  obtains 
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Furthermore,  under  the  same  condition  and  using  eq.  (B.i)  in 
Appendix  (  B)  the  density  of  t  can  be  shown  to  be 

p(t)  =  -  ■  y^2  0  4  for  t<T  \ 7, 10 ) 

a^t  a^vT 

If  we  relaxed  the  controls  on  the  test  and  were  content  with 

tolerating  a  larger  value  for  the  probability  of  cal3e  alarm  aT 

than  given  by  (7.8),  but  maintain  PT,  we  could  achieve  this  by 

lowering  x  and  correspondingly  raising  InB  While  maintaining 

InA-®.  The  ASN  of  course  decreases,  reflecting  the  increase  in 

a^.  As  we  continue  to  relax  our  requirement  a_,  and  lower  x, 

the  terminal  threshold  x  would  eventually  coincide  with  InB.  For 

a  continuous  process  lowering  x  below  InB  is  meaningless .  Thus 

even  for  this  minimum  value  of  x,  the  resulting  test  may  have  a 

value  of  smaller  than  the  required  a.  Exact  equality  could 
▲ 

then  be  achieved  only  by  lowering  the  threshold  InA.  This  i »\ 
turn  would  have  a  tendency  to  further  decrease  the  A®  of  the  teat, 
but  as  we  re introduce  the  upper  threshold,  the  important  problem 
of  a  non-uniqueness  of  threshold  setting  which  yields  the  desired 
probability  of  error  arises. 

7 . 3  Interaction  Between  Thresholds.  ASN.  and  Probabilities  of 

Error 

A  TS'.  of  Fig.  7-1  can  be  specified  when  the  three  threshold 
A,3  and  x  are  given.  Usually  the  test  requirements  are  stated  in 
terms  of  the  proodbi 1 it ies  of  false  alarm  (fO  and  false  dis¬ 
missal  A  third  condition  that  could  be  set  in  determining 

the  three  thresholds  which  will  result  in  a  TS?  with  specified 
controls  is  to  require  that  the  ASN  of  theTST  be  a  minimum.  Of 
course,  the  ASN  xs  a  function  of  tr.c  value  of  the  parameter 
and  as  such  we  can  require  minim. rat  ion  of  ASN  for  a  particular 
value  of  a  or  fur  a  m  a  specified  range.  The  exact  expression 
for  the  ASN  .s  given  in  the  Appendix  (A.d ) .  For  moat  applications 
the  first  term  of  the  infinite  sum  (A. 9}  yields  sufficient  accu¬ 
racy. 


An  example  of  the  effects  on  and  8p  as  a  result  of  vary¬ 
ing  the  thresholds  is  given  in  Figure  7-3.  In  the  first  column 
we  number  the  case  under  consideration;  in  the  next  column  we 
consider  raising  (♦)  or  lowering  (~)  the  threshold  given  in  the 
heading;  the  effects  of  this  change  on  the  threshold**  are  given 
in  the  last  section,  where  "+"  or  signify  an 

decrease  in  the  values  of  ctp,  Pp.  Initially  thresholds  InA,  InB, 
and  x  yield  performance  of  a^,,  8T  and  ASN.  The  results  of  each 
case  is  compared  with  this  initial  situation.  For  ixamp.e,  in 
Case  1,  raising  InA  will  decrease  me  probability  of  false  alarm;  to 
offset  this  a  decrease  in  the  terminal  threshold  x  will  increase 
otp  and  decrease  8^.  The  net  effect  on  tnese  probabilities  of 
error  could  be  zero,  but  the  ASK  would  1.  '2  been  increased  due 
to  the  raising  of  the  upper  threshold  InA. 

Not  all  possible  cases  are  illustrated  in  Fig.  7-3,  since  in 
some  cases  it  is  not  clear  what  would  be  the  net  effect  on  the 
ASN  for  certain  adjustments  of  the  threshold.  For  example,  if 
InB  and  InA  were  increased  simultaneously  the  resulting  probabi¬ 
lity  of  false  alarm  would  decrease  whereas  the  probability  of 
false  dismissal  would  increase.  A  lowering  of  the  terminal  thre¬ 
shold  could  possibly  compensate  for  this  change  in  the  error 
probabilities.  However  there  is  no  assurance  that  the  ASN  is 
uniformly  larger  or  smaller  than  in  the  case  before  the  thresholds 
were  adjusted.  If  a  i3  close  to  zero,  then  the  new  ASN  will  be 
smaller  than  in  the  previous  case;  if  a  is  close  to  a^,  the  con¬ 
verse  is  true.  Thus  whether  the  value  of  ASN  increases  or 
decreases  in  such  a  case  depends  on  the  true  value  of  the  para¬ 
meter  a. 

7 .4  Setting  the  Terminal  Threshold 

Tr  is  evident  that  there  are  at  least  two  ways  of  approach¬ 
ing  the  problem  of  truncated  sequential  tests.  The  first,  is  to 
determine  the  adjustment  on  the  three  thresholds  in  order  to 
arrive  at  the  desired  values  of  o  and  ?  according  to  some  cri¬ 
terion  on  the  ASN .  The  second  i3  to  fix  the  parallel  thresholds 
and  determine  the  position  of  the  terminal  threshold  in  some 
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and 
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desirable  way.  The  first  problem  has  been  considered  above  to 
some  extent.  We  now  consider  the  second  problem. 

2 

Wald  recognized  the  necessity  of  a  terminal  decision  in 
a  truncated  test  but  was  only  able  to  give  an  intuitive  answer 
to  the  question  of  Where  the  threshold  should  be  set.  He  felt 
that  "a  simple  and  reasonable  rule  for  truncation..."  was  to 
set  the  terminal  threshold  at  zero  and  accept  or  reject  the  null 
hypothesis  depending  on  whether  or  not  the  test  statistic  at 
truncation  is  positive  or  negative.  This  rule  teams  reasonable 
mainly  due  to  the  fact  that  Wald,  as  most  statisticians,  was  con¬ 
cerned  with  values  of  a  end  8  which  are  about  equal,  as  a  result 
of  which  zero  is  approximately  halfway  between  InA  and  InB.  In 
many  scientific  or  engineering  applications,  however,  a  and  B 
may  differ  by  several  orders  of  magnitude.  For  example,  in  radar 
sequential  detection  a  is  typically  in  the  order  of  10~4  to  10 
whereas  8  is  typically  in  the  order  of  lO-1  to  10-3.  Thus  the 
choice  of  zero  for  the  terminal  threshold  in  such  a  case  will 
have  a  tendency  to  disproportions lly  favor  :.ie  type  of  error  over 
the  other,  that  is,  if  many  tests  are  resolved  at  the  truncation 
stage,  such  a  choice  may  nave  a  tendency  to  drastically  change 
the  magnitude  of  the  errors  for  which  th^.  test  was  designed. 

There  is  no  unique  criterion  from  which  the  value  of  the 
terminal  threshold  can  be  determined  when  a  parallel  boundary 
test  is  truncated.  Ideally  we  would  want  x  to  be  chosen  such 
that  the  decision  at  truncation  would  be  exactly  the  one  which 
would  be  made  had  the  testing  continued.  This  ideal  situation 
is  unachievable  for  it  would  imply  that  a  T3T  could  perform  as 
well  as  the  optimum  test. 

One  possible  solution  is  to  set 

(InA  ♦  InB) 
x  =  2 

so  that  the  terminal  threshold  is  halfway  between  the  parallel 
thresholds  nA  and  InB,  This  rule  essentially  directs  the  ex¬ 
perimenter  to  accept  the  hypothesis  that  corresponds  cj  the 
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boundary  to  which  ZT  la  closest.  This  approximation  is  of  course 
very  useful  in  engineering  applications  where  a  simplified  tech¬ 
nique  is  of  greater  importance  than  exact  results. 


8 •  DENSITY  distributions  of  tst 

8 . 1  Total  Distribution  Functions 

There  are  several  density  functions  of  the  rampie  size  Whicn 

♦ 

can  be  studied,  several  of  which  are  related.  Probably  the  most- 
important  distribution  is  tne  density  of  the  sample  size  which  is 
not  conditioned  on  the  particular  terminal  decision.  This  dis¬ 
tribution  gives  the  density  p  (n)  of  the  number  of  samples  n 

a 

required  to  terminate  with  either  decision  when  a  is  the  true 
value  of  the  parameter.  Tne  density  p  (n)  is  the  total  density 
function  conditional  on  a..  It  follows  that  the  ftSN  of  the  test 
is  given  by 

00 

ASN  =  f  np  (n)  dn  (8.1) 

«J  _  3 


Now  if  the  test  is  truncated  at  n=N  and  the  thresholds  are  left 

unchanged,  the  new  density  function  pa(n;N)  is  unchanged  up  to 

n=N,  at  wh^ch  point  it  takes  the  form  of  a  delta  function  of 

strength  p  (n)an.  Thus  we  have 
JN  9 

00 

I  p.  (n)  +  6(n-N)  [  p  (n)  dn  for  n*N 


P_(n;N)  = 

a 


(8.2) 


and  the  new  ASN  takes  the  form 


ASM  =  j  np  (n)  dn  + 


Pa(n)  dn 


(8.3) 


Although  the  sample  size,  n,  is  a  discrete  variable,  the  distri¬ 
bution  of  n  can  be  approximated  by  a  continuous  distribution  when 
the  expected  excess  over  the  boundaries  is  small  and  the  step  size 
z.  is  small  relative  to  InA  and  IlnBl. 


By  definition,  an  abruptly  truncated  test  can  last  no 
longer  than  N  observations,  and  it  can  be  shown  that  on  the 
average,  it  must  take  less  observations  than  the  untruncated 
test  with  the  same  parallel  boundaries.  It  follows  from  (8.1) 
and  (8.3)  that  the  difference 

ASN  -  ASN..  =  f  (n~N)  p(n)  dn  (8.4) 

and  is  always  positive,  showing  that  ASN>A£N^.  Graphically,  the 
density  function  and  the  distribution  function  of  the  sample 
number  for  an  untruncated  and  a  truncated  test  are  shown  in.  Figs 
8-1  and  8-2.  Several  approximate  expressions  for  p  (n)  are 
available;  an  exact  expression  for  a  Wiener  process,  as  a  func¬ 
tion  cf  the  thresholds  and  the  value  of  a  is  given  in  the 
Appendix.  The  expression  for  the  ASNN  can  be  obtained  by  means 
of  (8.3)  and  is  also  given  in  the  Appendix  A. 3. 

8 . 2  Conditional  Distribution  Functions 

Other  distributions  of  interest  are  given  by  the  condional 
distributions  of  the  sample  size.  These  are  distributions  of 
the  sample  size  given  that  decision  d.^  is  made,  i=0,  1  when  a 

is  the  true  value  of  the  parameter,  and  will  be  denoted  by 

/  i  \  4  _ 

Pa*rij£^;.  It  can  be  shown  that  in  the  untruncateo  case  these 

conditional  densities  are  related  to  the  total  density  by  the 

expression 


Pa(n)  =  L(a)  pg(njd0)  +  [l-L(a)]  pa(n|dx)  (8.5) 


Wa  first  develop  the  corresponding  expression  for  a  TST,  and 
point  out  some  interesting  consequences.  We  will  then  find 
various  relationships  between  conditional  and  unconditional  den¬ 
sity  functions. 
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Let  a  (n!d, :N)  be  the  probability  measure  of  the  set  of 
a  i 

v.hose  tests  which  lead  to  decision  di  at  stage  n="5N  when  a  is 
the  true  value  of  the  parameter.  The  probability  that  the  TST 
terminates  at  the  nt?1  stage  with  either  decision  given  that 
truncation  i*  at  n=N,  is  given  by 


pg(n;N)  •-  i_a(n|do;N)  +  pa(nld1;N)  (8.6) 

It  is  important  to  point  out  here  that  ji  (nld, ;N)  for  x=0,l 

is  not  a  function  of  N  when  n<N.  That  is,  tests  which  have  ter¬ 
minated  at  n=m<N  are  not  influenced  by  the  value  of  N;  only  those 

tests  terminating  at  n=N  are  affected  by  the  truncation  stage. 

Of  course,  at  n=N,  the  value  of  the  test  statistic  is  compared 
against  the  terminal  threshold  x  in  order  to  arrive  at  a  decision. 
|  The  location  of  this  threshold  will  determine  which  tests  at  n-N 

will  declare  decision  di# 

Now  the  OCF,  which  is  the  probability  of  accepting  Ho,  can 
!  be  written  as 

i 

i 

!  r,=N 

!  L(a,N)  =  £  U  (n|d  ;N)  (3.7) 

!  n=1 

% 

t 

? 

»  from  which  it  follows  that 

f 

* 

1 

I  n=N 

1  -  L(a,N)  =  £  u  (n|d.;N)  (8.8) 

n=l  3  1 

These  expression?  can  be  wri'  ton  in  the  combined  form 
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(8.9) 


f* 

L^a,!*)  *  fll -2L(a,R) ]  i  4  LU,N)  =  £  pft(n  jd^ll) ,  5=0,1 


wher®  we  def ine  as  the  probability  of  accepting  hypothe¬ 

sis  Hi  for  h  test  truncated  at  n*K.  Also,  the  conditional 
probability  function  p  (n<3,?N)  can  be  written  as 

a  X  * 

,  .  p  (n)d  jN) 

P&(nK;N)  =  ^ f- - 1 - -  ,  nm  (8.10) 

E  Ma(e!d  I'H) 
n- 1 

This  is  the  probability  that  the  1ST  will  ternstnate  at  st,age  n 
giver*  tbtt  ‘-he  decision  is  d.,  and  that  a  is  the  true  value  of 
the  parameter . 

it  is  also  Important  to  point  out  here  that  although  u^CnldjjN) 
is  independent,  of  F  fur  ntK,  p  tnld,  is  dependent  on  the  value 

3  -v  81  ~LJ: 

Oi.  F  tor  n<F<  as  well  as  for  n=N;  L(a,N)  ot  course,  is  also  de¬ 
pendent  on  . 

Using  (3.7),  (8,8),  am**  (8.10)  with  i=0,  end  1=1  in  (8.6)  we 

get 

Pa(n;W)  -  L(a,a)  P#(n\l0;H)  *  [(l-L(a,N)]  p^njd^N)  (3. XI) 


lot  toe  us*- el  two  cases  of  interest  we  can  write  (3.11)  as 


Po(n;F)  *  U-aT)  P0in!do;N)  +  a?  p^nid^N)  (8,12a) 

for  signal  absent, 
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and.  for  signal  prssent, 


Pl(n}H)  *  eT  pl(nidQiN}  +  (1-BT>  p^nld^N)  (8.12b)  J 

Thus  we  have  arrived  at  the  analogue  of  48.5)  for  T§T  and  to  the  - 
interesting  conclusion  that  although  each  of  the  tvto  factors  in 
e«ch  term  on  the  right-hand  side  of  (8.11)  varies  with  the  value 
of  N,  each  term  (or  the  product  of  these  two  factors)  la  indepen¬ 
dent  of  N  for  n<N. 

Once  we  have  the  probability  function  of  the  sample  size. of 
an  untruncated  test  conditional  on  the  decision  d.^  being  made,  we 
may  then  wish  to  determine  the  corresponding  conditional  probabi¬ 
lity  functions  of  a  TST, 

Let  us  assume,  then,  that  we  are  given  p^nld^),  the  condi¬ 
tional  density  of  the  sample  size  n  for  an  untruncated  sequential 
procedure  when  a  is  the  true  value  of  the  parameter  given  that 
di$  .1=0,1.  is  the  decision  made.  We  wish  to  determine  p^njd^jN) 
for  nSJ,  Where  N  is  the  truncation  stage. 

Using  the  same  notation  as  above  we  have  that  the  measure  of 
those  tests  which  terminate  with  decision  d.,  at  stage  n  in  the 

-A. 

untruncated  procedure  is 

iia(n!di)  =  Pa(hldi)  Li(a)  (8.13) 

« 

where  L.  (a)=  (rJd  )  is  the  probability  of  making  decision  d 

1  H-*-  X  3  X  * 

when  £  it  the  value  of  the  parameter.  In  the  truncated  proce¬ 
dure  the  i  or  respond -1  r.a  relationship  is  given  by  (8.9)  where 
U  ^n!d.;N)=u  (n!i,),  when  n<N:  and  for  n=N: 

B  1  a  I 

Us(N,cii;N)  =  Lt(a,N)  -  ua(  Id.jN) 
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or 


N-l 


Ha(tfl4i?N)  *  L  'a,Nj  -JMa)  2  pfkjd,) 

V-  x*i  1 


(8.14) 


Now,  using  ^8,8)  and  (8.10.)  ws  can  writ*. 


P?(n|8i?N5  =  ”*■"■■■■  * 


^(a,!!) 


(8.15) 


or  substituting  for  ,x.  (njd4  jN) ,  we  get 

9  A  w 


WCa) 

iqtiTST  pa(n|di! 


Pa(n|dijN)  *< 


1  ~ 


Li(a;  N-l 


n<N 


(8.16) 


rjzyi  p«(k!ai)' 


n=N 


As  examples  of  this  last  expression  we  can  write,  for  signal  absent 


P0(n|d1}N) 


i;  p0<“!«i>. 


T-l 


n<N 


(8.17a) 


n=N 


and,  for  signal  present f 


■fc  Pi!nia0). 


P1(n|do;N)  * 


.  N-l 

i  -Hr  E  Pi^!<50), 

rT  k*l  *  0 


n<N 


(8.17b) 


n=N 
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We  can  make  certain  observations  at  this  point  *  It  is  not 
sufficient  to  know  pa(nldi)  in  order  to  obtain  p^njd^N); 
certainly  the  value  of  L^(a)  and  ti(a,N)  are  needed.  However , 
L^Ca^N)  can  be  easily  tabulated  as  a  function  of  H  in  contrast 
tc  PgCnld^iH).  Thus  we  have  reduced  the  problem  of  determining 
values  of  pj|(n!di|N)  as  a  function  of  n  and  N  to  the  simpler 
problem  of  tabulating  L^a,!*)  as  a  function  of  If  and  using  (8.1?) 
to  obtain  the  desired  distribution  function  of  the  sample  sise. 

In  particular,  iff  the  desired  quantities  are  to  be  obtained  from 
experimental  results  then  Li(afN)  can  be  easily  obtained  for 
each  value  of  N  in  the  course  of  determining  pa(nidi)  and  L^e). 
The  quantity  pa(nldi;N),  on  the  other  hand  can  not  be  obtained 
directly  because  of  the  dependence  of  pa(nld^;lf)  on  N  for  each 
n<2f,  as  was  noted  earlier.  Thua,  it  is  not  practical  to  tabulate 
Pa(nld^ ;N)  for  several  values  of  N  even  though  the  expreesion 
could  be  calculated  at  each  stage  of  the  sequent ial  pr^edure. 

The  expression  (8.17)  developed  above  is  reconroonded  When  selected 
values  of  p  (nld. ;N)  are  desired. 

9  X 

The  relationships  between  the  various  conditional  and  uncon¬ 
ditional  distributions  for  TST  can  be  obtained  by  starting  with 
tome  known  relationships  and  the  ones  derived  in  the  preceding 
section.  A  summary  ot  these  relationships  is  offered  in  Table  1. 
Some  of  the  expressions  are  equivalent  although  presented  in 
different  form.  These  are  listed  in  order  to  facilitate  their  use 
depending  on  a  user's  individual  need. 

Certain  comments  can  be  made  with  regard  tc  the  expressions 
given  in  Table  1. 

(a)  The  introduction  of  a  truncation  stage  N  implies 
the  use  of  a  terminal  threshold  x  which  determines 
the  decision  to  be  made  at  this  stage.  Thus  quan¬ 
tities  such  as  aT  and  are  in  fact  a  function  of 
this  terminal  threshold  although  its  functional  de¬ 
pendence  has  not  been  explicitly  indicated. 

(b)  The  Theorem  of  Buesgang -Marcus  which  establishes  the 
equality  between  the  density  functions  given  in  (3) 

of  Table  1  does  not  held  for  the  case  of  TST. *  * ^  These 
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latter  expressions  are  given  in  (6)  o f  Table  1. 

(c)  The  expression  p  fnld  :N)  in  (6;  depends  on  H  only 

through  cu..  Similar  statements  hold  for  the  other 

* 

density  functions  in  (6)  of  Table  1, 

id)  Since,  for  example,  amp„(n Id, ,N)  does  not  depend 
on  N  for  n<K  we  can  write 

gT  P0(n!dliN-  =  a  PD(n^i)  n-N 

(e)  For  continuous  testing  in  c  process  with  indepen¬ 
dent  increments  we  would  replace  the  summations  of 
m  —  1  r*r 

form  .  5,  by  the  integrals  j  dt . 


TABLE  1 

SUMMARY  OF  RELATIONSHIPS 


P0(n)  =  (t-a)  P0(n|d0)  +  a  po(n|dl) 
Pj(n)  »  8  p1(n|d0)  ♦  (1-8)  p^nldj) 


MB 

ifiifl 

'id 


P0(n|N)  *  (l-aT)  po(n|d0;K)  +  p^iifd^H) 

PjInjN)  *  ST  Pl(n|d0|B)  ♦  (l-8T)p1(n|d1;N) 


P0<n|dQ)  s  P^nlV  ’Theorem  of  Bussgeng-Mercue 


P0(n^dl)  =  Pi<nld!> 


Po(n,do)  = 


(1-8)  pc(n)  -  a  pjvi.) 


=  P^hUq) 


(1-M  P< (n)  -  8  p  (n) 

Pjtnldj)  =  - {H"«  -  Si -  *  ?5<nldr 


Potnfd^N)  = 


a  V 


p^nld^jK) 


1  -  5T  z  P0(k^i) 

T  k=i  1 

?:  Pi(n|V 


»  a  N-l 

!  l  -  T.  pt  (kjd  ) 

T  k“l  4  ° 


u  <  N 


n  *  N 


n  <  N 


n  *  N 
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( cont , ) 


1 '  HI;  po(kl  v  n  - N 


P1(n|d1jN)  * 


t“T-f~  P1(n|d1)  n  <  N 


1  -  '£—^ — I"11  2  PjOcId^)  a-**  K 

T  R~*l 


(i-a)(i-8)  P0(n)  -  a(l-a)  p^n) 


P0(n!d0;N) 


(l-aT)(l-a-l 


f  N-i  b 

\  (l-a){l-8)  ^  pQ(fc)  -  a(l-a) 

1  "  — - Ti^JTI^FJ — - 


8(1-8)  PQ(n)  “  z&  PjU) 


P1(n|d0-N)  = 


«i..»  tt.  y«  - «•  Ji  p^(k> 


T-c-m 


a(l-a)  P1(n)  -  a8  pQ(n) 


Po(n!d1*»i)  =j 


°U-a)  K|j  pjOc)  -  a8  k|  pQ(k) 


aT(l-a-S 


( 1-8) (l-a)  Pl(n>  -  {1-8)8  p  (n) 

_ '  A  _ _  O  . 


Pi(n|d1;H)  = 


l-o-l 


(1-BHl-a)  Klx  p  (k)  -  (1-8)8  I 


y.A 


jiimi 


P;  ;vi  *  •  ’ 


'  siB 
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9.  COMPUTER  SIMULATION  EXPERIMENTATION 


The  previous  analysis  applies  to  sequential  detection  on 
a  continuous  process  where  the  problem  of  excess  over  the 
boundary  does  not  arise.  In  practice  observations  are  taken 
at  discrete  instances  of  time.  Such  a  sampling  procedure  will 
generally  cause  the  value  of  the  teat  statistic  to  exceed  t  e 
boundaries,  thereby  over -deciding  on  the  hypothesis  indicated. 
Thus  a  fraction  of  the  last  observation  would  have  been  Suffi¬ 
cient  to  arrive  at  the  same  decision.  Such  fractional  steps  or 
observations  are  clearly  impossible  in  a  discrete  sampling 
process.  As  n  result  cf  this  the  discrete  test  lasts  longer 
than  if  the  sampling  were  done  continuously.  The  compensating 
effect  is  that  the  tesc  statistic  exceeding  the  boundary  over¬ 
decides,  thereby  indicating  the  decision  with  a  smaller  prob¬ 
ability  of  error  than  would  have  been  obtained  had  the  test 
statistics  just  touched  the  boundary.  Consequently  for  a  dis¬ 
crete  test  the  boundaries  can  be  set  closer  to  zero  to  obtain 
the  same  performance  (a.  <*)  as  in  the  corresponding  continuous 
test.  Both  of  these  factors  must  be  simultaneously  considered 
to  obtain  a  valid  measure  of  the  effect  of  discrete  sampling  on 
the  performance  of  the  test. 

In  order  to  study  the  performance  ot  discrete  tests,  the 
procedure  of  sequential  testing  was  simulated  on  a  digital 
computer  ar.d  the  pertinent  test  parameters  and  distributions 
were  tabulated.  Before  we  present  and  discuss  the  results  of 
the  computer  analysis,  we  present  a  description  of  the  simula¬ 
tion  procedure. 


For  purposes  of  computer  experimentation  a  more  general 
procedure  than  that  given  by  (3.5)  can  be  studied.  In  particular 
we  consider  a  Gaussian  process  with  an  unknown  mean,  bur  where 


the  samples,  are  correlated.  The  process  under  study  is  the 


first  order  Markoff  process,  or  “Re  noise" 
laticn  between  the  2nd  j**  observation 


where 
1 i 

ic>  r 


the 


corre- 
Tne  test 


statistic 


for  this  case  can  be  obtained  from  the  likelihood 
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ratio  (3.1).  T1m  rasult  la 


*B  ■  ■  J  1?S  J*lxl>  -  A  rV  *llxl+Kn)  * 


(9.D 


It  can  be  easily  verified  that  once  2L^  has  bean  f  oead, 
can  be  formed  from  the  recurrence  relation 


Z  * 

SoH 


3*  *  -  pxk  -  ^(1-p)  ]/(l*o)  (9.2) 


in  Which  the  observed  variable  x<  is  formed  from 


(9.3) 


where  n^,  representing  the  random  component,  is  a  Gaussian 
random  variable  having  zero  mean  and  unit  variance  aud  where  £ 
represents  the  true  value  of  the  parameter.  On  the  first  step 
*  a  ♦  n^  *  Correspondingly  we  have 


On  the  second  and  succeeding  steps  the  additive  noise  is  formed 
from  the  expression 


ni+I  =  wi  * 


(9.4) 


where  w.  is  a  random  number  !jc®  the  same  distribut'icn  aa  n, 
and  p  is  the  coefficient  of  correlation.  It  can  h#  easily 
*r«fi*d  that  the  autocor re. let i o«  of  «  end  r  whe,e  n  is 

?  _  \  S  -I  i 

e obstructed  according  to  19.4)  is  p;*  -  : .  Fig,  illustrates 
the  block  diagram  of  the  implementation  of  the  detector  r%- 
oresanted  by  Eg.  (9,1), 
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In  running  computer  experiments  for  sequential  tests,  it.  is 

beat  to  intentionally  cr.ooae  reasonably  large  val<-,<»e  of  the 
probabilities  of.  false  alarm  and  detect  ion  In  order  that  the 
sample  size  (and  thereby  computer  running  time)  be  within 
reasonable  limits.  It  ia  important  to  observe  that  if  a  and  8 
are  small  the  proportion  of  trials  ending  in  the  incorrect  de¬ 
cision  will  be  correspondingly  small  and  it  will  be  difficult 
to  compile  enough  data  to  achieve  stable  and  reliable  results 
about  system  performance.  By  virtue  of  the  Bussgang-Marcus 
theorem  it  is  possible,  however,  to  study  experimentally  the 
conditional  density  of  the  sample  size  of  the  testa  terminating 
in  the  more  "popular"  hypothesis  and  deduce  from  it  the  con¬ 
ditional  density  of  the  sample  size  of  tests  terminating  in  the 
other  hypothesis.  In  Fig.  9-2  we  show  the  result  of  40,000 
experiments.  It  is  clear  that  with  signal  absent  and  a  -  0.01 
most  events  terminate  at  the  lower  boundary  and  among  40,000 
experiments  only  some  400  will  terminate  at  the  upper  boundary 
which  is  insufficient  to  provide  a  stable  picture  of  po(njd^). 


EXAMPLE; 


The  express ior»3  for  the  ASK  and  OCF  for  a  TST,  (A. 3)  and 
( A. 0),  are  quite  involved  and  difficult  to  interpret.  In  order 
;,o  gain  insight  Into  the  interrelationship  of  these  expressions, 
graphical  results  obtained  by  computer  evaluation  ot  these  ex¬ 
pressions  are  presented  in  Figs.  10-1  throuqh  10-9  for 
selected  values  of  the  parameters.  Figures  10-1  and  10-2 
show  the  ASH  ai5  a  function  of  the  ratio  a/a.  for  various  values 
of  the  truncation  parameter  T.  The  uppermost  curve,  labeled 
T -  ®  gives  the  ASH  for  an  untruncated  teat  and  the  values  of 

1 

a  and  B  shown,  wnicn  determine  ti»n  fixed  boundaries  for  all  the 
te3ts,  are  tor  the  untruncated  case.  The  resulting  values  of 
a,p  and  p,  for  a  =  0.01  and  B  =  0.1  can  be  obtained  from  Fig.  10-? 
since  at  a  =  0,  OOF  =  1-a  and  a  =  a^  ,  OCF  =  «.  Tne  complete  per¬ 
formance  of  the  test  can  thus  be  obtained  by  examining  the  two 
Figures  10-1  and  10-3  For  example,  if  we  truncate  at 
**T  =  then  aT  =•  0.06,  PT  =  0.27  with  a* ASH  =  4.4  When  a/a<=0. 

Several  comments  can  be  made  from  Figures  10-1  and  10-2: 

The  value  of  a* ASH,  as  is  expected,  never  exceeds  the  value  a^T 
1  '  1  * 
but.  is  very  close  to  it  when  a|T  is  small  since  many  testa  ;.re 

then  resolved  only  at  truncation. 

Also,  wo  would  expect,  when  a<P  (i.e,,  InA  >  j InB { )  that 
2  2 
as  a.,T  increases,  the  value  of  c/a,  for  which  a.ASN  is  a  maximum 
-  I  z  j 

would  decrease.  That  is,  for  small  a^T  we  would  expect  the 

drift  of  the  Wiener  process  to  require  a  larger  positive  slope 

to  yield  the  maximum  ASN  than  Whan  a*T  is  relatively  large.  This 

expectation  is  borne  out  by  the  figures,  from  which  it  is  clear 

that  as  Sji*  increases,  the  value  of  a/a1  for  which  a' ASH  is  a 

maximum  decreases. 

On  closer  examination  we  woul.d  expect  that,  "When  a<0,  the 

3 

maximum  value  of  a1ASN  occur  for  that  value  of  a/a^  for  which 
the  Wiener  process  has  drifted  slightly  above  the  point 
^(inA  +  ir3)  at  the  truncation  stage  a*T.  That  the  maximum 
should  occur  for  a  value  of  a/a^  for  Which  the  expected  value 
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TIG.  !0-l  ASN  OF  A  TRUNCATED  TEST  vs.  o/o,;  CONTINUOUS 
rTtOCESS 
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*  0.001 


/  / 


0.25  0.5  0.75  IX) 

o/cri  -*■ 

FIG.  10-3  OCF  OF  A  TRUNCATED  TEST  v«  0/0|, 
CONTINUOUS  PROCESS 


of  th*  tnt»t  atitistic  i*r  scwewhat  larger  tnan  a  point  midway 
between  the  thresholds  at  the  truncation  point  follows  from 
the  fact  that  for  email  values  of  t,  E(Z(t})  is  verv  close  to 
the  lower  th  sshold  as  a  result  of  which  the  tests  would  tend 
to  terminate  early  unless  the  Wiener  process  drifted  away  from 
this  at'-orbing  boundary.  The  requirement  that  the  process 
drift  above  the  point  ^-(inA+lnB)  at  t=T  to  yield  a  maximum 
a*ASN  when  a<9  can  be  stated  equivalently  in  terms  of  the  ratio 
a/a,.  Thus,  we  want 

i 

E{Z(T) )  o  ^-(lnA  +  lnB) 

Which,  from  (A. 4)  leads  to  the  inequality 

a/ax  >  |(1  ♦  -nA--f  1?£)  (10.1) 

V 

The  results  in  Figs.  10-1  and  10-2  show  that  the  value  of  a/a^ 
for  which  a* ASN  is  a  utaximu®  does  indeed  satisfy  inequality 
(10.1). 

in  Figure  10t4  is  shown  the  probability  density  of  the  sample 
sire  for  a/a^O  end  a/ajsl.  The  decision  thresholds  were  set  by 
a*0.0i  and  These  curves,  caicuiaiad  for  the  testing  of 

the  drift  of  a  continuous  Wiener  process  eftould  be  compare-  with 
the  corresponding  curves  for  the  discrete  detection  procedure 
given  by  Figure  10-5.  The  similarity  of  the  shape  of  the  curves 
on  the  last  two  figures  %&  evident.  The  main  difference  lies 
iu  unac  cne  Ml;.  a.  »ed  to  terminate  the  discrete  de¬ 

tection  procedure  is  larger  than  in  tie  continuous  case,  #*  is 
to  be  expected  because  in  the  cess  of  continuous  procedure  sons 
energy  is  lost  in  the  excess  over  the  boundaries.  As  discussed 
in  Section  8  these  densities  hold  for  TST  up  to  the  truncation 
stage. 


FIG.  10*5  PROBABILITY  DENSITY  OF  THE  SAMPLE 
DISCRETE  PROCESS 


Curve.?  for  *  ne  OCr  of  a  TST  in  F  ;g.  >  ‘>-3  (as  weli  as  for 

a*T~")  were  £ r.owrs  with  the  terminal  threshold  set  a*  'he  mid- 
1 

point.  When  the  terminal  threshold  if  at  the  upper  boundary 
or  at  x-0 ,  tie  suggested  by  Wald,  the  resulting  probabilities  of 
error  are  shown  in  Fig,  10-6.  he  x  is  increased  from  x--Q  to 
x=.lnA,  aT  decreases  and  pj  increases,  but  the  value  of  x  has  a 
diminishing  effect  as  the  truncation  stage  increases.  This 
influence  of  the  terminal  threshold  can  be  studies  also  in 
Fig.  10-7.  Further  lnpight  into  relationships  between  the  dif¬ 
ferent  gueati* ie*  of  tne  TST  can  oe  obtained  from  Figs.  10-8 
end  10-9  in  which  ASN  is  plotted  as  a  function  the  truncation 

energy  a^T. 


57 


TRUNCATION  ENERGY;  o {T 

FIG.  10-6  PROBABILITIES  OF  ERRORS  FOR  A  TST  vs  TRUNCATION  STAGE, 
THRESHOLDS1  x  =  C,  in  A;  CONTINUOUS  PROCESS 


-4.6 
fn  B 


0 


13.8 
In  A 


TERMINAL  THRESHOLD:  x 

FIG.  10-7  PROBABILITIES  OF  ERROR  FOR  A  TST  vs. 

TERMINAL  THRESHOLD,  TRUNCATION  STAGES: 
o,rT  =21,  a,eT  *41;  CONTINUOUS  PROCESS 


58 


APPENDIX  A 


EXPRESSIONS  FOR  THS  ASN ,  OCF,  AND  DISTRIBUTION  FUNCTIONS 
OF  A  TRUNCATED  SEQUENTIAL  TEST 


A.  1  Introduction 

In  this  Appendix  we  give  exact  expressions  for  the  operating 

character  1st ic  function,  average  sample  number  and  distribution 

functions  arising  in  sequentially  testing  for  the  mean  of  a 

Gaussian  distribution.  As  in  the  main  body  of  this  report,  we 

are  interested  in  testing  the  hypothesis  H  that  the  mean  of  the 

o 

distribution  is  a  =  0  against  the  alternative  hypoches  is  K.  that 
a=a^>0.  The  samples  x^sed  in  arriving  at  the  decision  have  a 
Gaussian  distribution  with  mean  a  and  unit  variance.  Thus  the 
density  runction  of  the  samples  is  given  by 

(x, -a) 

l _ 

1  ~  2 

f(xi>a)  =  e  (A.i) 

J  2n 


th 


The  test  statistic  at  the  n  stage  is  given  by 


n 

Z  =  Z  z. 
"  K=1  k 


(A.  2) 


where  zR  is  obtained  from  the  kt?1  sample  x^  by  means  of  logarithm 
of  the  likelihood  ratio 


=  In 


fly 


V 


t  ( *  J7~oT 


/  A 
*  ^ 


3) 
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and  vhere  the  expected  value  of  z,  is  E(z.  }  =  u  ~  -  — 1  -  — ) 

rC  K  ^  2  *1 

The  test  statistic  Z  is  compared  against  two  parallel 
1  -  R  ^  g 

thresholds  InA  =  In  -  and  InB  ~  In  - -  such  that  decision  d 

a  1  -a  o 

to  accept  Hq  is  made  if  <  InB,  wheroa*'  decision  d^  to  accept 
H  is  made  if  Z >  InA.  The  testing  procedure  continues  as  long 
as  InB  <  Zn  <  InA.  If  at  stage  n=N  no  decision  has  Keen  reached, 
hypothesis  is  accepted  if  >  x,  and  Hq  is  accepted  if  Z^<x. 

It  is  very  difficult  to  determine  the  exact  values  of 

the  operating  characteristic  function  and  average  sample  number 

of  a  sequential  test  as  specified  above.  This  difficulty  is  due 

mainly  to  the  fact  the  test  will  not  in  general  terminate  with 

Z  equal  exactly  to  InA  or  to  InB.  In  general  Z  will  exceed 
n  n 

these  boundaries,  and  it  is  the  effect  c?  this  excess  which  is 
difficult  to  ana)y?.e. 

In  order  to  avoid  the  difficulties  of  excess  over  the 
boundary  when  the  test  statistic  is  discrete,  we  replace  by 
a  continuous  test  statistic  S{t)  on  Which  the  -sna  procedure 
is  followed  as  in  the  discrete  case.  We  are,  then,  testing 
for  the  drift  of  a  Wiener  process.  This  being  the  case,  we  have 


nrz(t)]  =  vi  t 


(A  4) 


ETZ(t)  -  E(Z(t>n2  =  a2t  (A. 5) 

X 

and  termination  time  T  in  place  of  E  Zm=um,  E[Z( t)-E(Z{ t) ) ]2=a2m 
and  termination  time  N. 
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A , 2  The  Operating  Character iat lc  Function 


In  a  continuous  sequential  test  tne  probability  of  false 
alarm  will  be  exactly  a  and  the  probability  of  false  dismissal 
will  be  exactly  when  the  test  is  untruncated.  In  fact,  tbe 
OCF  and  ASN  for  such  a  test  can  be  written  down  directly.  In 
tbe  truncated  case  for  a  continuous  sequential  test,  the  situation 
is  somewhat  involved.  The  GCF  is  the  probability  that  hypothesis 
H  is  accepted*  This  is  the  probability  that  Z(t)  touches  the 
boundary  InB  before  touching  InA,  plus  the  probability  that  Z(t) 
lies  between  the  boundaries  for  t<T  and  Z(T)<x.  The  expression 
for  the  general  case  of  non-parallel  boundaries  is  given  by 
Anderson.^  For  our  case  we  nave 


OCF  = 


<jj  (y!  .fr.rtrc-l"*)  <T)(-y  ■ 

r-1  L  1^ 


-e 


hrc 


C^-y  - 


2rc  .  -h ( rc+ InB ) 


ar/~T 


■)  -e 


5  (y-  llrc+lnBlj 


aiy~f 


+  e 


-hrc 


i  Sr*J 


(A. 6) 


Where 


A  =  ( l-B)/a,  B  =  P/(l-o .),  h  =  ( 1-2  —  >  , 

al 

x  h 

y  =  - ~  +  o -  ,  and  c  =  InA  -  InB, 

a1vrT  1 

and  Where  the  function  t(z)  is  given  by 
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(A. 7) 


i(z> 


-i-  f  e' 

- 


It  can  be  easily  checked  from  Eqn.  (A. 6)  that  for  T  =  ® 
c  =  1  -  OCFl  n  and  R  =  OCF! 

9-U  fl"*d  ^  m 

The  approximations  for  a^,  and  P^,  given  in  Section  7  of 
the  main  body  of  this  report  are  obtained  from  the  general 
expression  of  the  OCF  given  above. 

A. 3  The  Average  Sample  Number 

Few:  the  sane  truncated  continuous  sequential  teBt  as 
described  above,  the  ASN  is  given  by 


aj  ASN  ^  (ASN)1  +  (ASN)q  +  (a?  T)P  (A. 3) 


where 


a.lv/r 


[?.tc  +  InA) 


Jv 


»hrc(J)  al  ^  h  _  2rc+lnA 

^  2  ax  J? 


)J  [2rc  +  InAl 


-h(r+l)c  ^  _  ,  2L 


a*  */r 


(A. 9) 


h(rc-lnB)X  ,  alh^ 


^  (- 


-)Jt2(r+l)c-lnA;)'j 


and  {ASN)o  is  obtained  v*fcer,  InA  and  -lnB  are  interchanged  and 
h  is  replaced  by  -h  in  (A. 9).  That  is 


64 


(A£N(lnA,  InB,  h))Q  -  (ASN(-lnB,  -InA,  -  h)^ 
Also  P  =  [1  -  ( Pj  +  PQ)}  where 


ath  JT 
2 


+ 


_ InA  v 

ax  7f 


(A. 10; 


.( 2,.(  r.-lj  c.i  1  nA).  v 

<1^ 


e-rnc(f,(  -  i2l£^lpA)., 

*  2  atVT 

^(rc-lnAjr,^^  +  „rhC  [l-<$<^  +f^,]} 


and  F  Is  obtained  from  P„  with  the  same  substitutions  as  pre- 
o  1 

scribed  for  (-ASN)^. 

It  is  not  a  difficult  ratter  to  check  from  Eqn.  (A. 8)  that 
when  T  ^  <*>, 

\  a2  A3N ry0  =  -  i (l-a)lnB  +  alnA] 

snd 

2  °1  ASN!a=a1  =  PlnB  +  ( 1- p)  InA 

These  are  the  well -know:)  expressions  for  the  ASN  for  an  untrun- 
cated  test. 


A. 4  The  Density  Function  of  the  Sample  Siae 


Again,  tor  the  same  test  which  led  to  the  expressions  (A. 6) 
for  the  OCP  and  (A.E)  for  the  ASP,  we  get  that  the  probability 
density  p(t)  of  the  test  length  t  is  given  by 


P(t)  =  pt(t)  +  po(t) 


(AJ1) 


Where 


Pl(t)  =  *3^372  0  (  2 


l**  ,  InA 


2rc 


( r c* InA) 


V 


?AJt  r- 


)  I  j(2rc  ♦  lnA)e  1j 


.2l£»ii£  (rc.iaB) 

aft 

-  (  2c(  r+i )  •  InA)  e  1 


} 


(A. 12) 


and  p  (t)  is  obtained  from  p, (t)  by  interchanging  InA  with  -InB 
o  * 

and  replacing  h  by  -h.  Tlie  function  0(x)  :>■  given  by 


The  function  p^vt)  is  such  that 


t 

r  __  !  \  x.  i  _ 

j  p . « .  ; uX  1 3 


hiltty  ’'hat  decision  d ^  is  made  before  time  t.  The 

P^(t)  is  of  course  the  same  as  giver,  by  Eqn.  {A.  10), 

property  that  P  ( ®)  ♦  P, ( ®)  =  1.  Also,  for  example, 
o  i 

whan  and  P_,(»)  -  ?  when  a  =  a,  r 


the  proba- 


express ion 
and  has  the 

(  *)  =  a 
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APPENDIX.  B 

APPROXIMATIONS  TO  THE  DENS  ITT  FUNCTION  OF 
THE  SAMPLE  SIZE  OF  SEQUENTIAL  TESTS 

In  the  case  of  a  sequential  test  for  the  mean  of  a  Gaussian 
process,  the  exact  expression  for  the  density  function  p(t)  of 
♦•he  sample  size  of  an  untruncated  test  can  be  obtained.  This  13 
equivalent  to  the  distribution  of.  the  first  passage  time  for  a 
random  walk  with  two  parallel  absorbing  barriers.  The  exact 
expression  is  given  by  Eg.  (A-ll)  . 


p(t)  =  >,  (t)  +  p  (t) 

i  o 


(B.l) 


where 


P,  (t)  ~ 


a.WT  .  &  a?t 

77277372"  0  (^T“  +  -~7=)  T  l(2rc  +  tnA)e 

a^v  t  £-q 


(rc  luA) 


(rc  -  tnE) 


~(2c(r+l)  -  InA)e 


and  P^(t)  is  obtained  from  ( 1 5  by  interchanging  f.nA  with  -fnB  and 
replacing  h  by  -h,  In  this  expression  for  the  density  function: 

c  -  <<nA  -  tn3, 

h  r  ;  i  _  £3.  s 
n  ‘  a,'  * 

i. 

a  true  signal -to-noise  ratio 

*i  preset  signal-to-oot*e  ratio 


0(x)  *  'exp  -  x  /2}/V  2r 


For  most  purposes  an  approximate  expression  is  adequate. 


one  such  expression  can  be  obtained  by  considering  the  first 
term  of  the  infinite  sum  which  appears  in  the  exact  expression. 
Thus  we  have  that  the  probability  density  function  p(t)  of  the 
test  length  t  (or  first  passage  time)  car  be  approximated  by 


2c 

a2t 


p(t) 


(bnA  -  ( 2c  -  bnA ) B  -  ]  .  + 

(aft) 2/2  2  -  ^ 


T’ 


(-fnl 


(a2t 


(2c  - 

,371 


nB)  A 


2 

*r 


0 


na ,  ■, 

/ _ ±_ 


tn.B 
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If  the  test  proceeds  by  diocrete  sampling  the  approximate  p.d.f, 
of  the  terminal  stage  n  is  obtained  bv  replacing  t  with  n. 

A  further  simplification  is  possible  if  we  also  assume  that  in 
(2.2)  2-0  and  .1  >  0.  The  approximate  expression  for  the  p.d.f. 

then  becomes 


p(t) 


.na 


TTi 


2«trvA) 


!  P.  5i 


where 


and 


b8 


* 


2 

The  egression (S. 3)  checks  after  suitable  pubstitutions ,  Wald's 
formula  (A. 183,  p*193). 

*■> 

A  further  approximation  is  possible  if  (ptnA)/c  is  large, 
i.e.  if  many  steps  are  needed  to  reach  the  bound.  The  distribution 
of  t  given  by (B.i)  approaches  then  the  Gaussian  distribution  about 
its  mean 


It  is  clear  that  the  caset&>0,  8=0  represents  essentially  the 
random  walk  with  only  the  upper  boundary.  The  case  of  random  walk 
with  only  the  lower  boundary  is  represented  by  B>0  and  A  infinite. 
The  expressions  appropriate  to  this  case  can  be  obtained  simply 
by  replacing  InA  by-fnB  wherever  -tnA  appears  in  (B.3)  and  (B„4)„ 
Another  useful  approximation  applies  to  the  case  A=l/B  [see 
Bussgeng  and  Middleton4  (7.74),  (7.75)] 

We  note  also  that  if  z  is  the  logarithm  of  the  probability 
ratio  of  a  test  with  independent  samples  but  is  not  a  normal 
variable,  then  the  p=d.f,  of  the  sample  size  for  B=0,  A>0  can  still 
be  approximated  by(B„3)  where  u  and  o *  are  now  Ez  and  Var  z. 
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